Multimodal comprehension of graph-text constellations: an information processing perspective
نویسنده
چکیده
منابع مشابه
Introduction Advances in Text Comprehension: Model, Process and Development
To a very large extent, children learn in and out of school from written text. Information Communications Technologies (ICT) offers many possibilities to facilitate learning by confronting children with multimodal texts. In order to be able to implement learning environments that optimally facilitate children’s learning, insight is needed into the cognitive processes underlying text comprehensi...
متن کاملMultimodal Comprehension of Graphics with Textual Annotations: The Role of Graphical Means Relating Annotations and Graph Lines
Graphs are often accompanied by text, i.e. linguistically coded information, augmenting the information presented diagrammatically. Thus, graph comprehension by humans often constitutes comprehension and integration of information provided by different representational modalities, namely graphical elements and verbal constituents. In this study we focus on textual annotations to line graphs pro...
متن کاملCausal Inference in Graph-Text Constellations: Designing Verbally Annotated Graphs**Supported in part by DFG (German Science Foundation) in ITRG 1247 ‘Cross-modal Interaction in Natural and Artificial Cognitive Systems’ (CI-NACS)
Multimodal documents combining language and graphs are wide-spread in print media as well as in electronic media. One of the most important tasks to be solved in comprehending graph-text combinations is construction of causal chains among the meaning entities provided by modalities. In this study we focus on the role of annotation position and shape of graph lines in simple line graphs on causa...
متن کاملAn Optimal Approach to Local and Global Text Coherence Evaluation Combining Entity-based, Graph-based and Entropy-based Approaches
Text coherence evaluation becomes a vital and lovely task in Natural Language Processing subfields, such as text summarization, question answering, text generation and machine translation. Existing methods like entity-based and graph-based models are engaging with nouns and noun phrases change role in sequential sentences within short part of a text. They even have limitations in global coheren...
متن کاملThe Impact of Contextual Clue Selection on Inference
Linguistic information can be conveyed in the form of speech and written text, but it is the content of the message that is ultimately essential for higher-level processes in language comprehension, such as making inferences and associations between text information and knowledge about the world. Linguistically, inference is the shovel that allows receivers to dig meaning out from the text with...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2009